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A METHOD AND A SYSTEM FOR CAPTURING A WIDE-FIELD IMAGE 
AND A REGION OF INTEREST THEREOF 

The invention relates to a method and a system for 
capturing a simply connected wide-field image, and where 
5 applicable for displaying and processing the image. 

In the present document, the expression ^^simply 
connected" is to be understood in the mathematical sense. 
In the context of the invention, it means that the wide 
field observed is connected (i.e. consists of one piece) 
10 and does not have any ^^holes", unlike a peripheral field 
of view, for example, in which there is a loss of field 
around the axis of symmetry. 

The invention is more particularly directed to a 
method and a system for capturing or viewing a region of 
15 interest of an image that has a much higher resolution 
than the remainder of the image, preferably using the 
same matrix sensor. 

The invention finds non-limiting applications in 
image processing systems, surveillance and remote 
20 surveillance systems, observation systems on moving 

vehicles or robots and, more generally, in applications 
requiring a very high resolution. 

This kind of method may be used in particular to 
explore a wide-field image covering an entire half-space 
25 by '^sliding'' the observed region of interest, and in 

particular by optically zooming onto or sensing on the 
region of interest. 

Methods and systems for displaying and processing 
panoramic images and portions thereof are already known 
30 in the art. 

The prior art methods are more particularly data 
processing or mathematical processing methods for 
correcting distortion or delaying the onset of the grainy 
appearance that occurs on enlarging a portion of a 
35 panoramic image obtained with a fish-eye lens. 

US patent No. 5 185 657 in particular discloses the 
use of mathematical functions to correct distortion in a 
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region of interest of a panoramic image. 

French patent No. 2 827 680 discloses a method of 
enlarging a panoramic image projected onto a rectangular 
image sensor and a fish-eye lens adapted to distort the 
5 image anamorphically . 

Finally, US patent No. 5 680 667 discloses a 
teleconference system in which an automatically selected 
portion of a panoramic image corresponding to the 
participant who is speaking at a given time is corrected 
10 electronically prior to transmission. 

To summarize, the methods and systems referred to 
above process a panoramic image digitally to enlarge a 
region of interest thereof. 

Those methods all have the drawback that the degree 
15 of resolution of the selected image portion is limited by 
the resolution of the fish-eye lens for acquiring the 
panoramic image. 

Another prior art system, disclosed in US patent 
application No. 2002/0012059 (DRISCOLL) , uses a fish-eye 
20 lens to duplicate the image plane. 

The system includes a first matrix sensor placed in 
a first image plane and a second matrix sensor placed in 
the second image plane, the pixels of the first matrix 
sensor being smaller than those of the second matrix 
25 sensor. 

The first matrix sensor is moved in translation or 
rotation in one of the two image planes to scan the wide 
field with higher resolution. 

The person skilled in the art will realize that the 
30 increase in the resolution of the area of interest of the 
image in the above system is equal to the ratio of the 
size of the pixels of the two matrix sensors. 

A system of the above type, in which the resolution 
is directly dependent on the resolution ratio of the two 
35 sensors, is unsuitable for use in many applications, and 
in particular: 

- in applications in the infrared range 
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(3 micrometers (pm) to 5 pm and 8 pm to 12 pm) , for which 
there are no sensors with dimensions enabling enlargement 
by a factor of 10, for example, and 

- in applications in the visible range with 
5 resolution factors greater than 10. 

Another prior art system, described in US patent 
application No. 2003/0095338, uses mirrors of complex 
shape to capture a peripheral field and image it on one 
or more video cameras. 
10 Unfortunately, such systems all have a field of view 

capture system that is blind over a portion of the field, 
ruling out obtaining a simply connected wide-field view. 

The invention aims to alleviate the above drawbacks. 
To this end, a first aspect of the invention 
15 provides a system for capturing an image acquired by a 

simply connected wide-field optical system consisting of 
an afocal lens with angular enlargement of less than 1 
and supplying a wide-field first light beam. The system 
comprises : 

20 - means for selecting from the first beam a second 

light beam corresponding to a narrow field within the 
wide field and showing a region of interest of the image; ' 

- a first video camera including a lens adapted to 
capture the narrow-field second beam with a first 

25 resolution; 

- means for duplicating the wide-field first light 
beam to produce a duplicate first beam; and 

- a second video camera including a lens adapted to 
capture the whole of the duplicate first beam with a 

30 second resolution lower than the first resolution by a 
reduction coefficient defined by the ratio between the 
wide field and the narrow field. 

The second video camera and the first video camera 
preferably have identical matrices of photosensitive 
35 elements. 

Thus the capture system of the invention uses a 
purely optical technique to increase the resolution of 
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the area of interest of the image, even when the 
photosensitive element matrices of both video cameras are 
identical . 

Moreover, the system of the invention can capture 
5 the entire half -space. 

The invention therefore makes it possible to observe 
a region of interest of a wide-field image with a 
resolution much higher than that available with prior art 
systems and methods. 
10 In a first variant, the first video camera being 

mobile, the selection means include means for positioning 
the first video camera in a position such that it 
receives the second beam. 

In a second variant, the first video camera being 
15 stationary, the selection means include deflection means 
for deflecting the second beam towards the first video 
camera. 

Thus both the above variants capture a region of 
interest of a wide-field image with a high resolution 

20 without it being necessary to move the first video camera 
over the whole of the wide field. Assuming, for example, 
that the wide field corresponds to a half-space (180°) 
and that the reduction coefficient defined by the ratio 
between the wide field and the narrow field is equal to 

25 10, it suffices to move the first video camera (or the 

deflection means) over an angle of 18° to cover the whole 
of the half -space with the first video camera. 

A particularly fast capture system is therefore 
obtained. 

30 When the capture system is onboard a vehicle or a 

robot, it is highly advantageous for the overall external 
size of the capture system to correspond to only the lens 
of the wide-field stationary optical system. This 
feature is particularly important if the system is 

35 installed in aircraft with severe aerodynamic 
constraints . 

The first video camera preferably includes an 



5 

optical zoom system for defining the angular magnitude of 
the region of interest. 

In a preferred embodiment, the system of the 
invention further comprises means for duplicating the 
5 first beam to produce a duplicate first beam and a second 
video camera for capturing all of the duplicate first 
beam. 

In a first variant of this preferred embodiment, the 
capture system of the invention comprises a station for 
10 viewing the image in the vicinity of control means of the 
selection means. 

It is then possible to position the first video 
camera in the second beam corresponding to the region of 
interest with reference to the wide-field image as a 
15 whole and to control the optical zoom system from the 
viewing station. 

Thus the observer is able to enlarge a portion of 
the panoramic image from the viewing station, for example 
by means of a lever or a joystick, the resolution of the 
20 region of interest being defined by the characteristics 
of the first video camera. 

In a second variant of the preferred embodiment, the 
capture system of the invention includes means for 
processing the image adapted to detect a movement and/or 
25 a variation of luminous intensity in the image and to 
control the selection means accordingly. 

This variant is particularly suitable for 
surveillance and intruder detection applications. 

In a variant that is primarily for military use, the 
30 optical system and the first video camera are adapted to 
capture first and second infrared light beams. 

The invention also provides a system for capturing 
an image covering a 360° space, the system comprising two 
capture systems as briefly defined above arranged back- 
35 to-back, the optical systems of the capture systems being 
adapted to cover a half -space. 

Since the advantages of the above capture method and 
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the above system for capturing an image covering a 360° 
space are exactly the same as those of the above- 
described capture system, they are not repeated here. 
Other aspects and advantages of the present 
5 invention become more clearly apparent on reading the 

following description of one particular embodiment of the 
invention given by way of non-limiting example only and 
with reference to the appended drawings, in which: 

- Figure lA shows a preferred embodiment of a 
10 capture system of the invention; 

- Figures IB and IC show details of the Figure lA 
capture system; 

- Figure 2 shows another embodiment of a capture 
system of the invention; 

15 - Figure 3 shows to a larger scale the spaces 

observed by each of the video cameras of the embodiment 
of the system shown in Figures lA to 2; 

- Figure 4 shows main steps E5 to E90 of a preferred 
embodiment of a capture method of the invention; 

20 - Figure 5A shows a preferred embodiment of a 

capture system of the invention covering a 360° space; 
and 

- Figure 5B shows details of the Figure 5A capture 
system. 

25 The preferred embodiment described below with 

reference to Figures lA to IC in particular uses an 
afocal dioptric optical system 1. 

The afocal dioptric optical system is shown in 
detail in Figure IB. 
30 It consists primarily of three successive optical 

units 1000, 1001 and 1002. 

The optical unit 1000 captures light rays from the 
simply connected optical field in front of it. 

A prism 1001 (which may be replaced by a mirror) 
35 deflects the rays, if necessary, as a function of 

constraints on the overall size and mechanical layout of 
the system. 
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The rear unit 1002 provides optical magnification at 
the exit from the afocal optical system. 

Figure IC shows in detail the shape of the light 
beams 6 at the exit of the afocal system 1 and at the 
5 entry of the lens 11 of the video camera 10. 

The optical beam 4' at the exit of the afocal system 
1 and at the entry of the lens 21 of the video camera 20 
are the same shape. 

The wide-field afocal dioptric optical system 1 
10 having an axis Z is known in the art and is mounted in an 
opening 2 in a wall 3. 

The wall 3 may be the casing of an imaging system, 
the skin of an aircraft fuselage or the ceiling of 
premises under surveillance. 
15 The afocal wide-field optical system 1 of the 

invention has angular magnification of less than 1. 

This optical system 1 produces a first light beam 4 
coaxial with the axis Z. A beam duplicator 5 on the path 
of the first light beam 4 reflects the first beam 4 in a 
20 direction Y that is preferably perpendicular to the axis 
Z to generate a duplicate first beam 6 with axis Z. 

The lens 21 of a mobile first digital video camera 
20 on the path of the first light beam 4 with axis X and 
on the downstream side of the duplicator 5 captures only 
25 a narrow second light beam 4' that is part of the first 
light beam 4. 

This video camera 20 is equipped with a matrix 22 of 
photosensitive charge-coupled devices (CCD) and means 23 
for generating and delivering a stream of first 
30 electrical signals 24. 

A transceiver 15 equipped with a multiplexing system 
then sends the first signals 24 by radio, infrared or 
cable means to an observation station described 
hereinafter . 

35 The lens 11 of a stationary second digital video 

camera 10 coaxial with the axis Y captures the whole of 
the duplicate first beam 6. 
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The second video camera 10 is also equipped with a 
matrix 12 of photosensitive charge-coupled devices and 
means 13 for generating and delivering a stream of second 
electrical signals 14 representing the panoramic image 
5 captured by the second video camera 10. 

The transceiver 15 sends these second electrical 
signals 14 to the observation station. 

Apart from their lenses 11 and 21, the two video 
cameras 10 and 20 may be identical. In particular, the 
10 number of pixels defined by the photosensitive device 
matrices 21 and 22 may be identical. The images or 
photographs of identical . size obtained from the two 
streams of signals 14 and 24 then have the same 
resolution. 

15 The streams of signals 14 and 24 sent by the 

transceiver 15 are received in the observation station by 
the receiver of a second transceiver 30 which is also 
equipped with a multiplexing system. 

Streams of second signals 14' received by the second 

20 transceiver 30 and equivalent to the streams of second 
signals 14 are processed by an image distortion and 
information processing electronic system 40 which 
supplies to a memory 41 data showing a wide-field image 
42 captured by the second video camera 10. 

25 The wide-field image 42 is displayed on a screen 43 

and the data of the image 42 may be stored in an archive 
on a storage medium 44 for later viewing . 

In the same way, streams of first signals 24' 
received by the second transceiver 30 and equivalent to 

30 the streams of first signals 24 are processed by a second 
image distortion and information processing electronic 
system 50 that supplies to a second memory 51 data 
showing a region of interest 52 captured by the first 
video camera 20. 

35 The region of interest 52 is displayed on a second 

screen 53 and the data of the region of interest 52 may 
advantageously be stored on a second storage medium 54 
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for later viewing. 

The electronic systems 4 0 and 50 may advantageously 
be replaced by a commercial microcomputer running 
software for processing the image distortion inherent to 
5 wide-angle lenses, such as those known in the art. 

Without departing from the scope of the invention, 
the region of interest 52 of the wide-field image 42 may 
also be embedded in the wide-field image 42 and displayed 
on the same screen as the wide-field image. 
10 The observation station also includes a browser 60 

for browsing the wide-field image 42. 

For example, the browser 60 may include a joystick 
for positioning a cursor 61 in the wide-view image 42 
displayed on the screen 43. 
15 The position of the cursor 61 defines the angular 

coordinates 6x, 6y of the region of interest 52 of the 
wide-field image 42 filmed by the first video camera 20 
that the observer wishes to display on the second screen 
53. 

20 The coordinates x and y_ defined by the browser 60 

are preferably delivered to the second electronic system 
50 so that it can correctly process the distortion of the 
image captured by the first video camera 20. 

The angular coordinates 9x, 9y are also supplied to 

25 a system 63 that delivers to the second transceiver a 
first train of signals 64x showing the value 0x and a 
second stream of signals 64y showing the value 0y. 

The second transceiver 30 sends the signals 64x and 
64y to the transceiver 15 of the imaging system. 

30 The first stream of signals 64x' received by the 

transceiver 15 and equivalent to the first stream of 
signals 64x is delivered to a control unit 70 of a first 
electric motor 71 for pivoting the first video camera 20 
about the axis X to capture the narrow field of view 

35 corresponding to the second beam 4' . 

Similarly, the second stream of signals 64y' 
received by the transceiver 15 and equivalent to the 



10 

second stream of signals 64y is delivered to a control 
unit 72 of a second electric motor 73 for pivoting the 
first video camera 20 about the axis Y in the first light 
beam 4 . 

5 The second light beam 4' captured by the first video 

camera 20 is selected by pivoting the first video camera 
20 about the axes X and Y. 

The movements of the first video camera 20 obviously 
correspond to angular coordinates in the wide-field image 
10 42 displayed on the screen 43, of course. 

Note that the angular coordinates 0x and 9y of the 
wide-field image 42 correspond to an observed field 
viewing angle close to 180*" even though the angular 
movements 0x and 9y of the first video camera 2 0 in the 
15 first light beam 4 are very small. 

This enables the first video camera 20 to be moved 
very quickly to the position (0x, 0y) selected by the 
observer and to capture the second light beam 4' 
corresponding to the region of interest 52 of the wide- 
20 field image 42 that will produce the high-resolution 
region of interest 52 . 

As shown in Figure 1, the browser 60 is 
advantageously associated with a system for displaying 
the angular magnitude 80 of the region of interest 52 to 
25 be displayed on the screen 53. 

The corresponding information is delivered to an 
electronic system 81 that generates corresponding signals 
82 sent by the second transceiver 30 to the first 
transceiver 15 of the imaging system. 
30 The corresponding received signals 82' are delivered 

to a control unit 8 3 of an optical zoom system of the 
first video camera 20. 

The region of interest 52 displayed on the second 
screen 53 will therefore enlarged to a greater or lesser 
35 extent as a function of the adjustment of the optical 
zoom system, preserving the same resolution. 

It is therefore possible to view details of the 
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wide-field image 42 with great precision. 

In a different embodiment, the capture system 
includes image processing means (for example software 
means) adapted to detect a movement and/or a variation of 
5 the luminous intensity in the wide-field image 42 and to 
command the selection means accordingly. 

Image processing means of this kind are known to the 
person skilled in the art and are not described here. 
They are adapted in particular to perform conventional 
10 segmentation and shape recognition operations. 

Figure 2 shows a different embodiment of a capture 
system of the invention. 

Figure 2 does not show the observation system of 
this embodiment, which is identical to that described 
15 with reference to Figures lA to IC. 

In this embodiment, the first video camera 20 is 
stationary and the second beam 4' is deflected towards 
the first video camera 20 by a prism 100 rotatable about 
the axis Y. 

20 In other embodiments that are not shown here, the 

prism 100 may be replaced by other deflection means and 

in particular by a mirror or any other diffraction system 

known to the person skilled in the art. 

Figure 3 shows the narrow field of view 90 that 
25 produces the second light beam 4' that is captured by the 

first video camera 20 and the wide field of view 91 that 

is captured by the second video camera 10. 

Figure 4 shows main steps E5 to E90 of a preferred 

embodiment of a processing method of the invention. 
30 During the first step E5, a wide-field image 42 is 

acquired with a wide-field optical system 1 providing a 

first light beam 4. 

This acquisition step E5 is followed by the step ElO 

during which the first light beam 4 is duplicated. 
35 This duplication may be obtained using a duplicator 

5 as described briefly with reference to Figure 1, for 

example . 
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The duplication step ElO is followed by the step E20 
during which the whole of the duplicate first beam 6 is 
captured, for example by the second video camera 10 
described above. 
5 In the present embodiment, the step E20 of capturing 

the duplicate first beam 6 is followed by the step E30 of 
viewing the wide-field image 42 obtained from the 
duplicate first beam 6 by the second video camera 10 on a 
viewing station, for example on a screen 43. 
10 This viewing step E30 is followed by steps E40 to 

E70 of selecting a second light beam A' from the first 
light beam 4 . 

To be more precise, during the step E40, a cursor 61 
is positioned in the wide-field image 42 displayed on the 
15 screen 43. 

This cursor may be moved by means of a joystick, for 
example . 

Be this as it may, the position of the cursor 61 
defines angular coordinates 8x, 0y of a region of 

20 interest 52 of the wide-field image 42 that the observer 
can view on a second screen 53, for example. 

The step E40 of positioning the cursor 61 is 
followed by the step E50 of positioning the first video 
camera 20 so that it captures a second beam 4^ 

25 corresponding to the region of interest 52 selected 
during the preceding step. 

The step E50 of positioning the first video camera 
20 is followed by the step E60 of selecting, from the 
viewing station, the angular magnitude of the region of 

30 interest 52 to be displayed on the screen 53. 

The step E60 of selecting this angular magnitude is 
followed by the step E70 during which the optical zoom 
system of the first video camera 20 is adjusted as a 
function thereof. 

35 The step E70 of adjusting the optical zoom system is 

followed by the step E80 during which the second beam 4' 
corresponding to the position and the angular magnitude 
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of the region of interest 52 is captured. 

The step E80 of capturing the second beam 4' is 
followed by the step E90 during which the region of 
interest 52 is displayed on the screen 53, for example, 
5 or embedded in the panoramic image 42 displayed on the 
screen 43. 

The step E90 of displaying the region of interest 52 
is followed by the step E40 of positioning the cursor 61 
described above. 

10 In another embodiment, the step E20 of capturing the 

duplicate first beam is followed by a step of processing 
the wide-field image 42 to detect a movement or a 
variation of luminous intensity therein. 

This image processing step therefore determines the 

15 angular coordinates 9x, 0y of a region of interest 

automatically, rather than the coordinates being selected 
by means of the cursor 61 as described above. 

In a further embodiment, instead of moving the first 
video camera 20 (step E50) , deflection means are pivoted 

20 as a function of the angular coordinates 9x, 0y to 

deflect the second beam 4' towards the first video camera 
20. 

Figure 5A shows a preferred embodiment of a capture 
system of the invention covering a 360° space and Figure 
25 5B shows details thereof. 

The capture system comprises two capture systems A 
and A' as described above with reference to Figures lA to 
Figure 2 arranged back-to-back. 

In this embodiment, the optical systems of the two 
30 capture systems A and A' are adapted to cover more than a 
half-space, as shown by the cross-hatched portions H and 
H' , respectively. 

The person skilled in the art will readily 
understand that the cross-hatched portions Rl and R2 are 
35 overlap regions captured by both systems A and A' . 



